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We systematically calculate various flavor-changing neutral-current top-quark processes induced 
by supersymmetry at the Large Hadron Collider, which include five decay modes and six production 
channels. To reveal the characteristics of these processes, we first compare the dependence of the 
rates for these channels on the relevant supersymmetric parameters, then we scan the whole param- 
eter space to find their maximal rates, including all the direct and indirect current experimental 
constraints on the scharm-stop flavor mixings. We find that, under all these constraints, only a 
few channels, through eg ^ t at parton-level and t — > ch, may be observable at the Large Hadron 
CoUider. 

PACS numbers: 14.80.Ly, ll.30.Hv 

I. INTRODUCTION 

The study of various flavor-changing neutral-current (FCNC) processes has been shown to be very useful. In 
particular, as the heaviest fermion in the standard model (SM), the top quark may play a special role in FCNC 
phenomenology. In the SM the FCNC interactions of the top quark are extremely suppressed by the GIM mechanism, 
so that no FCNC top quark rates can reach an observable level at current or future colliders [1-3]. Thus, the 
observation of any FCNC top quark process would be a robust evidence for new physics beyond the SM. Due to its 
heaviness, the top quark is very sensitive to new physics. Indeed, several models beyond the SM often predict much 
larger FCNC top quark interactions [4] . Such FCNC interactions can induce various top quark production and decay 
channels, which can be explored in future collider experiments [5, 6] and serve as a good probe for new physics. 

So far, much effort has been spent on the exploration of the FCNC top quark interactions. On the experimental side, 
the Tevatron CDF and DO collaborations have reported interesting bounds on the FCNC top quark decays from Run 
1 experiment and will tighten the bounds from the ongoing Run 2 experiments [7]. On the theoretical side, various 
FCNC top quark decays and top-charm associated productions at high energy colliders were extensively studied in 
the SM [1-3], the Minimal Supersymmetric Standard Model (MSSM) [8-12] and other new physics models [13-15]. 
These studies showed that the SM predictions for such processes are far below the detectable level. However, some 
new physics can enhance them by several orders of magnitude, which makes them potentially accessible at future 
colliders. 

The Large Hadron Collider (LHC) at CERN will be a powerful machine for studying the top quark properties such 
as its FCNC interactions since it will produce top quarks copiously. Analysis [5] showed that some FCNC top quark 
rare decays with branching ratios as low as O(10~^) could be accessible at the LHC. Due to its high energy and high 
luminosity, the LHC will be the main utility for exploring FCNC top quark production channels [5] . 

The minimal supersymmetric standard model (MSSM) is a leading candidate for new physics beyond the SM and 
its consequences will be extensively explored at the LHC. In this paper, we throughly investigate various top quark 
FCNC processes in the framework of the MSSM. A characteristic feature of the model is that, in addition to the 
FCNC interactions generated at loop level by the CKM mixing matrix in the SM, it predicts FCNC interactions from 
soft SUSY breaking terms [16]. These additional FCNC interactions depend on the squark flavor mixings, and for 
the case of top quark, they are sensitive to the potentially large mixings between charm squarks (scharms) and top 
squarks (stops). 
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In this paper, we will examine six production channels, which proceed through the parton-level: 

99 tc, (1) 

eg ^ t, (2) 

eg tg, (3) 

eg ^ tZ, (4) 

eg t7, (5) 

eg th, (6) 

and five FCNC top quark decay modes: 

t ^ eg, (7) 

t egg, (8) 

t cZ, (9) 

t ^ C7, (10) 

t ^ c/i, (11) 

Among these, the decays t eg, egg, eZ, cj, eh and the production gg tc have already been studied in the MSSM 
before [8, 11, 12], while the others have not been studied so far. Here we perform a comprehensive study of all these 
processes in the MSSM for the following purposes: 

(1) Since in the MSSM all these processes are induced mainly by scharm-stop mixings and each of them involves the 

same set of SUSY parameters, they are correlated. Although some of them have been studied in the literature, 
they were treated individually in different papers. Even though a combined analysis has been done in [5] 
within the framework of cfTcctivc Lagrangian where the coefficients of all FCNC interactions are independent, 
such analysis is missing in an explicit model. Therefore, a comprehensive and comparative study of all these 
processes in an explicit model is necessary. 

(2) Through a comparative study of all these channels, we could determine the relative size of their rates. This is 
useful since the LHC experiments can in principle measure each of them and the pattern of relative rates can 
be tested. Only by considering all these processes together, we might know which one has the largest rate and 
will hopefully be discovered at the LHC, if the MSSM is the correct framework. 

(3) By scrutinizing the dependence of the rates of these transitions on the relevant SUSY parameters, one can 
determine the most sensitive parameters of the model and then discuss how the future LHC measurements 
could possibly bound them. 

(4) Performing the scan over the whole parameter space, subject to all the direct and indirect current experimental 
constraints on the scharm-stop flavor mixings [17], the maximal rate for each process can be determined and, in 
this way, we can pinpoint which ones are hopefully observable at the LHC. Of course, this does not mean that 
one should give up searching for those low-rate processes at the LHC. As stated above, the LHC measurements 
can readily place bounds on the sensitive SUSY parameters and such bounds are complementary to the current 
experimental constraints, most of which are indirect constraints. 

This paper is organized as follows. In Sec. II we discuss the possible sources of flavor violation in the MSSM and give 
the FCNC interaction Lagrangian relevant to our calculations. In Sec. HI we introduce a method to calculate various 
top quark FCNC processes. This method, as will be shown, can greatly simplify our calculations. The predictions of 
the rates are given in Sec. IV, with emphasis on illustrating the characteristics of their dependence on the relevant 
SUSY parameters. In Sec. V we consider various experimental constraints on the sources of flavor violation and scan 
the parameter space to find the maximal rates at the LHC. We draw our conclusion in Sec. VI. Finally, we give the 
expressions for the loop results in the Appendix. 



II. FCNC INTERACTIONS IN THE MSSM 



There are two sources of flavor violation in the MSSM [16]. The flrst one arises from the flavor mixings of up-quarks 
and down-quarks, which are described by the CKM matrix (inherited from the SM). The second one results from the 
misalignment between the rotations that diagonalize the quark and squark sectors due to the presence of soft SUSY 
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breaking terms. This source can induce large top quark FCNC processes and is the focus of investigation in this 
paper. 

In the super-CKM basis with states {ul, cl, iz, ur, cr, Ir) for up-squarks and (rfi, sl, bL, (Ir, sr, hR) for 
down-squarks, the 6x6 squark mass matrix [q = u, d) takes the form [16] 

j^2^( iM?)LL + ml+ cos2/3M|(r| - Q.s^^)! (M|)z,k - m,/z(tan^)-2^3 \ 

' V - rn,M(tan/3)-2^3 (M|)«« + + cos2/3M|Q,s^i J' ^ ^ 

where the soft mass parameters {M?)^^, {M?)^^ and {M?)jm are 3x3 matrices in flavor space, 1 stands for the 
unit matrix, niq is the diagonal quark mass matrix, Tg = 1/2 for up-squarks and Tg = —1/2 for down-squarks, and 
tan (3 ^ V2/V1 is the ratio of the vacuum expectation values of the Higgs fields. In general, the soft mass parameters 
arc flavor non-diagonal. Since the low energy experimental data, such as K'^ — K'^, — and Bj] — mixings, 
require the flavor mixings involving the first generation squarks to be negligibly small [16], we only consider the fiavor 
mixings of the second and third generations and parametrize the soft mass parameters as 

I Ml 

\ 5llMq,Mq, 

/ 

{MDlr = 6lrMq,Mu, 

{MDrr = {MI)ll\mI , Sll^Srr, (13) 

for up- type squarks. Similarly, for down-squarks we have 



(M|)ifl = I St^Mg^Mo, 



TUbAb 



{Mj)RR = {Mi)LL\MA,^Mi„ s^^^sU- (14) 



Due to SUl{'2) gauge invariance, {M^)ll is given by 

{MI)ll = V^j,j^{MI)llVckm. (15) 

Note that the mixing parameters, 5''' in the down sector defined in Eq. (14) are independent of 5 in the up sector 
defined in Eq. (13), and in general, 5lr 7^ For the diagonal elements of left-right mixings in Eq. (13) and 

Eq. (14), we only kept the terms of third-family squarks, since we adopted the popular assumption that they are 
proportional to the corresponding quark masses. 

It is clear that the mixing parameters in the squark mass matrices afi'ect both the squark mass and its interactions. 
For example, in the presence of flavor mixings, squark-quark interactions are given by 

V{qXq'„) = V{qXq',) , (16) 

where V{qXq'^) denotes the interaction in squark mass-eigenstates, V{qXq^) is that in the interaction basis, X may 

be gluino, neutralino or chargino, and Tq is the unitary matrix which diagonalizes the squark mass matrix. For the 
convenience in the following discussions, we give the interaction Lagrangian for up- type quarks [16, 18]: 

3 

Cuug = E "^ds T^t k {TurPL r - ul (r^)('+3)« Pn r < + ii.c.1 , (i?) 



i=l 

4 



(18) 



^ o y -iMw sin p J 

2 3^ 

'^udx+ = E E 5 [^-2 ( 70,7" • o ^ckmU Pl xt {^0)"^ L - uAU^,{VcKMh]PR xt da 

+ Ui [VCKM^^ -).,] PRxt (r75)«+=^)« L] + h.c. , (19) 

v2Mivcosp J 
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where T° are the SU{3)c generators, i = 1,2,3 is the generation index, a = 1,...,6 is the squark flavor index, 
s and t are color indices, N is the 4x4 rotation matrix defined by N* M^aN~^ = diag(m-j^o, m^o, "^x"' "^x")' 
the index a refers to chargino mass cigenstates, and V and U are the visual chargino rotation matrices denned by 
U* M^+V^^ = diag(m-+ , m^+). From the above interactions one can see that FCNC ncutralino and gluino interactions 

Xi X2 

only arise from up- type squark mixings, while the FCNC chargino interactions arc induced from both the off-diagonal 
elements in the CKM matrix, and from the flavor mixings in down-type squark mass matrix. 

Although each of the above interactions contributes to the top quark FCNC transitions by gaugino mediated loops, 
the contributions could be of quite different magnitude. Since both the neutralino and gluino contributions depend on 
the same parameters in the up-typo squark mass matrix, their different coupling strength indicate that the ncutralino 
contribution is much smaller than the gluino contribution, except for a very massive gluino and light neutralino 
scenario. Noting that B-physics requires small S'^ < 0(0.1) [19-21], the FCNC interactions induced by charginos 
arc in general not large. Recently, these three typos of contributions to gg tc at the LHC were simultaneously 
calculated in [12], and it was shown that both the neutralino and the chargino contribution are several orders of 
magnitude smaller than the gluino contribution for most SUSY parameter space. Since we are mostly interested in 
the parameter regions with large predictions for FCNC processes, in this paper we consider only the gluino-mediated 
contributions. 

Even if only the gluino-mediated loops are considered in calculating the top quark FCNC interactions, the model 
has still a large parameter set. Beside the gluino mass, there are nine soft mass parameters in the scharm-stop mass 
matrix, which complicates our analysis. In order to simplify our calculations, we neglect the charm quark mass. Then 
the amplitude squared for any top quark FCNC mode/channel considered in this paper can be decomposed as 

\M\^ = \M\l + \M\l, (20) 

where |M|| (|M||i,) is the amplitude sriuarod with a left-handed (right-handed) charm quark, as either an external 
state or internal state in Feynman diagrams. Furthermore, by using the mass insertion method[22], one can easily 
find that |M|| (|M|^) vanishes if there is no left-handed (right-handed) scharm mixings with stop, and that these 
amplitudes have a weaker dependence on right-handed (left-handed) scharm mixings than on the left-handed (right- 
handed) scharm mixings. These features, verified numerically by our calculations, motivate us to consider the; case 
with only left-handed scharm mixings in top quark FCNC processes. In this case, the relevant soft mass parameters 
are reduced to seven, since we set Srl^rr = and M^^ is irrelevant to our calculation (see Eq. (13)). Throughout 
this paper, we always consider this case, but we note that for those transitions not involving W, Z bosons, the results 
for |M|| can be apphed to |M||, with the substitutions L and My. ^ Mq-. 

Another reason for considering only left-handed scharm mixings with stops is that these are well motivated in 
popular flavor-blind SUSY breaking scenarios, STich as the mSUGRA model [23] and gauge-mcdiat(xl SUSY-brcaking 
models [24]. In these models, the sfermion-mass matrices arc flavor diagonal at the SUSY-brcaking scale, but the 
Yukawa couplings can induce flavor mixings when evolving the matrices down to the electroweak scale. Estimates of 
these radiatively induced off-diagonal squark-mass terms indicate the magnitude for left-handed flavor mixings are 
proportional to bottom quark mass, while those for the right-handed scharm are proportional to charm quark mass 
[25]. Therefore, in phenomenological studies of scharm-stop mixings, one usually assumes the existence of left-handed 
scharm mixings. 

Finally, it should be pointed out that although we make use of the parametrization in Eqs. (12-14), which is widely 

used in the literature for the calculations by mass insertion approximation, our calculations are the full computation 
in the mass eigentsate basis of squarks (that is we first diagonalize the squark mass matrices and then perform the 
loop calculations in the mass eigentsate basis). Such a treatment, unlike the mass insertion method [22] which makes 
sense only for 6' s < 1. can allow for 5' s > 1 (as will be shown in Sec. V, in some cases S's > 1 can be permitted 
by all experimental constraints because we use non- universal squark mass parameters, that is Mq, Mjj and Mjj are 
not degenerate). Note that although all our rnuricrical results are obatincd from such full computation in the mass 
eigenstate basis, we will utilize the mass insertion method when we try to qualitatively explain the behaviors of some 
results. 



III. THE EFFECTIVE VERTEX METHOD 

We introduce a method which can greatly simplify our calculations since it avoids repetition of the evaluation of 
a same loop-corrected vertex in different places, or in different processes. All results in this paper were obtained by 
this method, and some of them were cross-checked by other tools such as FormCalc [26]. 

The key point of our method is the so-called "effective vertex". To illustrate this method we consider gg tc 
as an example. The Feynman diagrams for this process are shown in Fig. 1. The SUSY-QCD contributions to the 
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c — t transition and the vertex teg, as well as the box diagrams, are given in Fig. 2. Noting that the amplitude for 
Fig. 1(a) can be split into two terms, one containing a charm quark propagator, and the other containing a top quark 
propagator 



Ma oc = — 5 2" «^(<?) 



4-mt 



(21) 



we collect the first term together with Fig. l(e, f), and combine the second term together with Fig. l(g, h). After this 
arrangement, we can define a momentum dependent effective icg interaction as 



f — mi mi — mi 



(22) 



where F^'^^ is the penguin diagram contribution to the effective interaction and F^'^ is the usual QCD vertex. Then 
the calculation of Fig. l(a-h) is equivalent to the calculation of the "tree" level transition depicted in Fig. 3(a-c), 
which obviously has a simpler structure. By following this method, our calculations can be greatly simplified, since 
the effective teg interaction appears in many processes, and the effective teg interaction is the same for all channels 
considered in the paper. 

K t 

— — a — s — ^ " 



g 

(a) 




(b) 











c 


g c 

(f) 


g 


t 




t 








c. 


g c 
(f) 

g t 




Box 





(i) 




FIG. 1: Feynman diagrams for gg — > tc. Additional diagrams with the two gluons interchanged are not shown. 
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FIG. 2: SUSY-QCD contribution to c — t transition, teg interaction and box diagrams for gg tc. 



Of course, the effective vertex teg is model-dependent since its components F^^^ and S are model-dependent. We 
obtained their expressions in SUSY QCD analytically. We retain the tensor loop functions rather than expanding 



g eg 
(a) 



eg e 
(b) (c) 



g t g t 




g eg c 



(d) (e) 
FIG. 3: Effective diagrams for the process gg tc. Here Vj/-^ is the effective teg interaction defined in Eq. (22). 



them in terms of scalar loop functions as usual [27]. This method makes our results quite compact and also simplifies 
our Fortran codes which will be discussed below. 

The effective vertex teg in Eq. (22) is a 4-component Lorentz vector and also a 4 x 4 matrix in Dirac spinor space. In 
its realization in Fortran coding, we use a dimension-three array V{i,j, k) with i (=1,2,3,4) labeling the Lorentz index 
and j, k (=1,2,3,4) labeling the spinor indices. We also use arrays to encode other quantities such as Lorentz vectors, 
Dirac spinors, Lorentz tensors and Dirac 7 matrices. The steps to calculate the effective interaction in Fortran code 
can be then summarized as follows: 

• Input the matrices Pl,r, J^Pl,r and a^'^ . For any other matrices encountered in the calculation, we use 7 
algebra to generate its elements. 

• Use the mass splitting method [28] to generate events with momentums for the initial and final particles. 

• For a generated event with fixed momenta, the components of any tensor loop function can be calculated 
numerically and stored in arrays. 

• Generate the 7 matrices 7'*^ • • • 7^" and contract its Lorentz indices with those of tensor loop functions and 
those of quark momenta to obtain the effective vertex. 

To calculate the amplitude of gg — > tc, we also need to calculate box diagrams. Such calculations are usually 
tedious if the four-point tensor loop functions are expanded in terms of scalar loop functions. Since we choose 
to retain the tensor loop functions and contract the indices numerically, our results are quite compact, as shown 
for gg — > tc in the Appendix. The general expression for a box diagram is the sum of fermion chain of the form 
(y-yMi . . -jf^^u) X Dfj^....^^ X p^^ ■ ■ ■ and its numerical value is calculated by the following steps 

• Input the wave functions for fermions and define the multiplication of 7 matrix with the wave function. 

• Generate the tensor, say u - ■ ■ -ff^^-i-jt^^u, and contract its indices with those of loop fmictions Df^....f^. and those 
of vectors involved, to get the value of each term in the amplitude. 

With the method introduced above, we can also easily calculate other FCNC interactions. Let us take the calculation 
of eg — > tZ as an example. Its Feynman diagrams can be obtained from Figs. 1-2 by removing those involving triple- 
gluon interaction and gluon-gluino-gluino interaction, and then replacing any gluon with Z boson. Using the technique 
from Eq. (21) to introduce the effective teg interaction and the effective teZ interaction, one can again get simplified 
diagrams similar to Fig. 3(b-e). 

Once gg — > tc is calculated, evaluation of the others t eg, eg —^ tg and t egg becomes rather easy. The decay 
t — > eg is now a tree level interaction induced by the interaction teg. The amplitudes (or their conjugates) for eg — > tg 
and t egg are related to that of gg tc, and can be easily obtained by making some simple replacements which 
can be easily realized in our code. 

In the Appendix, we list the explicit forms of all the penguin-induced FCNC interactions discussed in this paper. 
These interactions are needed to obtain the effective top FCNC interactions. 
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IV. NUMERICAL RESULTS AND DEPENDENCE ON SUSY PARAMETERS 

We know, from the discussion in Section II, that the calculations of the SUSY-QCD contributions induced by the 

flavor mixings between left-handed scharm and stop, depend on the parameters Mq^ 3, Mf/.,, Xi = Ai — //, cot /3, m^, 
5ll and Slr. In this section, we investigate the dependence of the numerical results on these parameters. We first 
show the results for top quark rare decays. These decay modes occur only via one effective interaction and thus 
their dependence on the parameters is relatively simple. We perform a comparative study and plot the results for 
these decays together, to illustrate their dependence on a given set of parameters. After analyzing the features of the 
top quark rare decays, we extend the study to the FCNC top quark productions. They usually involve two effective 
interactions and several box diagrams, and thus their dependence on SUSY parameters is more complex. 
The SM parameters used in our calculations are [29] 

mt = 172.7 GeV, rub = 4.8 GeV, mz = 91.19 GeV, 

sindw = 0.2228, as{mt) = 0.1095, a = 1/128. (23) 

After the assumptions discussed in Sec. Ill, about 10 SUSY parameters are still involved. We will show below the 
dependence on SUSY parameters of the top FCNC processes. When one of the parameters is varied, the others will 
be fixed to their "central" values, taken as 

MsusY = = = Mq^ = 500 GeV, Xt = 1000 GeV, rUg = 250 GeV, tan/3 = 5. (24) 

The values of Sll and Sj^j^ will be shown in the figures. With the exception of the last plot in this section (Fig. 12), 
we adopt the so-called m^'^^ scenario [30] which is widely discussed in Higgs physics, and which assumes that all the 
soft mass parameters are degenerate 

MsusY = Mq, = Mu^ = Md,, (25) 

and that all the trilinear couplings are also degenerate, A„. = A^., with X^/Msusy = 2. In investigating the processes 
t ^ ch and eg — > th, we used the loop-corrected lightest Higgs boson mass and the effective Higgs mixing angle[17, 31]. 
These two quantities involve two additional parameters /x and niA, which are fixed as 

lj, = mA = 500 GeV. (26) 

In our calculations we use CTEQ6L [32] to generate the parton distributions with renormalization scale fxn and 

factorization scale iip, chosen to be /i/j = /ip = mt- To make our predictions more realistic, we applied some kinematic 
cuts. For example, for the three body decay t egg we require that the energy of each decay product be larger than 
15 GeV and the separation of any two final states be more than 15° in the top quark rest frame. For the top quark 
production channels, we require that the transverse momentum of each produced particle be larger than 15 GeV and 
their pseudo rapidity be less than 2.5 in the laboratory frame. Moreover, for eg ^ t followed by f — > bW, we do not 
require the top quark exactly on mass shell and instead we require the invariant mass of bottom quark and W boson 
in a region of mt — 3Tt < M^w < mt + 3Tt (Fj is the top quark width). This requirement was once used in [33] to 
investigate the observability of this channel at hadron colliders in the effective Lagrangian framework. 

Furthermore, we vary the flavor mixings. Sll and Slj^, over a wide range, with the only requirement that they 
satisfy current collider searches for sparticles and Higgs bosons [29]: 

mq > 96 GeV, m-g > 195 GeV, > 85 GeV. (27) 

In principle, some low energy data, such as 5 — s transition and Sp, can also constrain these mixings [17]. But 
those so-called indirect constraints are usually quite complicated. To simplify the discussion in this section we do not 
impose these indirect constraints, but we address such a question in the next section. We checked that the conclusions 
obtained in this section are valid in the region favored by these indirect constraints [60] . 

In Figs. 4-6, we present the branching ratios of various FCNC top quark decays, defined with respect to the width 
Tt{t bW) (~ 1.45 GeV). We plot the six branching ratios for the decays in Eq. (7)-(ll) as functions of mg, Msusy 
and Xt in the upper two diagrams of Fig. 4, the lower two diagrams of Fig. 4 and Fig. 5, respectively. We also show 
the dependence of the branching ratios on the squark mixing parameter 5ll {^lr) by fixing the value of 5lr {Sll) 
in Fig. 6. These figures show some common features of all the gauge boson decay modes. The first one is that, 
as the sparticles become heavy, the branching ratios drops monotonously (see Fig. 4), a reflection of the decoupling 
property of the MSSM. The second is that, as shown in Fig. 5, the branching ratios increase with the increase of 
Xf. This is because Xt affects the squark mass splittings and could alleviate the cancellation between different loop 
contributions. The third feature is that the branching ratios increase rapidly with the flavor mixing Sll and 6lr, 
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FIG. 4: The branching ratios of FCNC top quark decays. Unspecified parameters are given in Eqs. (23-26). The values of 5ll 
and Slr are arbitrarily chosen, and a smaUer value will lower the rates, but not change the tendencies of these curves. 
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FIG. 5: Same as Fig. 4, but as functions of Xt{= At — ficot /?). 



because the flavor mixings can not only enhance the coupling strength of squark flavor changing interactions, but 
also enlarge the squark mass splittings. This is illustrated in the first two diagrams of Fig. 6. These last two effects 
combined make the branching ratios very sensitive to the flavor mixing parameters. 

By comparing the case 5ll with the case 6lr throughout Figs. 4-6, one finds that Slr induces larger rates 
with weaker dependence on sparticle masses. Furthermore, when both Sll and Slr are non-zero, as can be inferred 
from the last two diagrams of Fig. 6, the Sll and the Slr. dependences interfere destructively. To understand such 
behaviors, we resort to the mass insertion method, as it can give more intuitive results [22]. We take the decay t ^ eg 
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as an example. By gauge invariance, the general expression for the effective teg interaction takes the form 

r,, = Fiie)tT^{k^j^ - ¥)PLcg'' - mtF2ikyna^,k''PLcg'' (28) 

where Fi^2{k'^) are form factors arising from loop calculations. For the decay t eg, Fi does not contribute, since 
the gluon momentum k^ satisfies fc^ = and fc • e = 0. So only the dipole moment term is relevant to our discussion. 
Noting that the dipole changes both the flavor and the chirality of the fermions, we may infer the form of mtF2 in 
the mass insertion approximation. If only 5ll is considered for flavor changing, mtF2 must be 

rUfSLL , m~gdLLmtXt 
™*-^2 - V72 ^ + — 774 -t;, (29) 

where Msusy — raax{mg, Mq), and A,B are dimensionless constants coming from loop functions with l/AfJ^gy 
factored out. The first term corresponds to the top chirality flipping contribution, i.e., obtained by using the relation 
Utjjlt = rritUt, while the second term corresponds to the — mixing contribution, and thus associated with the 
gluino mass. The situation is quite different for 6lr 0, which alone can be responsible for both flavor changing and 
chirality flipping. In this case, mtF2 should be 

rrigSLR ^ .„„N 
mtF2 = — I C. (30) 

where C, like A and i3, is a dimensionless constant coming from loop functions with 1 jM'gjjgy factored out. Comparing 
Eq. (29) with Eq. (30), we find that the latter is larger if m-g ^ mt- Assuming that rrig ~ M,, Eq. (29) scales like 
1/M|ygy while Eq. (30) scales like XjMsusY. This explains the fact that Sj^^ induces larger rates with weaker 
dependence on sparticle masses. Moreover, a detailed calculation shows that mtF2 in Eq. (29) is of opposite sign to 
that in Eq. (30), which means that the (5^^ contribution tends to cancel the (5^^ contribution. 
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The decay t —>■ ch has similar features to the decay into a gauge boson except for a rather compHcated dependence 
on MgusY and Xj, as shown in Figs. 4-5. For the effective ich interaction, with both the top and the charm quarks 
on-shell, the general expression is 

mi-DiP.ch, (31) 

where Z) is a form factor emanating from the loop calculation. This interaction, like the effective icg interaction, also 
involves both flavor change and chirality flip. So in some aspects, the behavior for t ch should be similar to t eg. 
But its dependence on Xt is more complicated than other decay modes. The reason may be that Xt not only affects 
the masses and mixings of squarks, but also affects the Higgs boson mass and its mixing angles, and, further, it enters 
the interaction of q*qh. 

An interesting feature, shown in Figs. 4-6 is that the branching ratio oi t ^ eg is always smaller than the higher 
order decay t — > egg. This was observed in the SM [2] and the MSSM [12], and it indicates that the QCD corrections 
to t eg may be important. Two reasons may account for this behavior. One is that the QCD factor in the 
amplitude-square for t — > egg is much larger than that for t eg. The other reason is that, unlike the case t eg, 
Fi in Eq. (28) also contributes to t egg and this contribution is important. From Figs. 4-6, one finds that, in most 
cases 

Br{t egg) > Br{t -> eg) > Br{t eZ) > Br{t 07), (32) 
and in some cases Br{t ch) may be the largest. 




FIG. 7: The cross sections of the FCNC top quark productions at the LHC. Each curve labeled by the final states corresponds 
to a certain production channel. 



After giving the branching ratios for the FCNC top decays comparatively, we now consider the FCNC top quark 
production channels. At the LHC the production proceeds through the six parton-level processes shown in Eqs. (1-6), 
among which only gg tc has been extensively studied in the MSSM[11, 12]. In calculating the cross section for 
each channel, we also include the rate for its charge conjugate channel. In the following discussions we use the parton 
process to label its contribution to the hadronic one. Thus, the cross sections mentioned below refer to the hadronic 
ones. 
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FIG. 9: Same as Fig. 7, but as a function of the mixing parameters. 



The dependence of the cross sections on SUSY parameters is plotted in Figs. 7-9. These figures exhibit the same 
features as the FCNC top quark decays in Fig. 4-6. Thus we do not repeat drawing attention to the same features, 
and we only point out three remarkable points of these diagrams. The first is that the rate of eg ^ i is generally 
larger than that for gg — > tc. This is possible because the charm quark in the parton distributions mainly comes from 
the splitting of a gluon [32] and thus eg ^ t can be seen as gg — > tc with the final charm quark going along the beam 
pipe. Analyzing the signal versus background [33, 34], it seems that eg t provides a better opportunity for the 
observation of top production. The second point is that the rate of eg tg is comparable to gg — > tc in most cases. 
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This coincides with the results in [35] where both modes were studied in the effective Lagrangian approach. Since the 
two processes have the same signals at colliders, namely single top plus one light-quark jet, one should combine these 
two when searching for the FCNC top production events. The third point is that in most cases the cross section for 
eg — *■ th is one order of magnitude smaller than that for gg — > tc. The reason is that although eg — + th can proceed 
either through teg interaction or ich interaction, the two interactions interfere destructively and thus the combined 
contributions are suppressed. 

As shown above, in most of parameter space the rates are expected to be quite small at the LHC. In order to 
study the observability of such rare processes, it is necessary to scan the whole parameter space to figure out the 
maximum value that each process can reach. We call the 'favorable region' the part of parameter space which gives 
the maximum value for the rate of an individual channel. Of course, such favorable region is process-dependent. In 
what follows we take gg — > tc as an example to carry out such a parameter scan explicitly. In the next section, the 
maximal rates for all processes will be tabulated, after discussing the effects of the indirect constraints on the flavor 
mixing parameters. 

In Fig. 10 we plot the maximal cross section for gg ^ as a function of Xt with non-zero 5ll (left panel) and 5lr 
(right panel). The maximum value is obtained by fixing Msusy and Xt but varying rrig and or 5 lb.- In searching 
for such maximal values, we required ruq > 100 GeV and rrig > 200 GeV. 

For non-zero 5ll , we find that the parameter points for the maximal cross sections correspond to the lightest squark 
mass and the giuino mass fixed at their allowed lower bound, i.e., 100 GeV and 200 GeV, respectively. This can be 
easily understood from the decoupling property of the MSSM. At such optimum points, if Msusy is fixed, Xt value is 
related to 5ll- Since both Xt and 5ll are the off-diagonal elements in squark mass matrix, a large Xt will correspond 
to a small J^l and vice versa. Then from Eq. (29), one can see that neither large nor small Xt can predict the largest 
rate for gg — > tc. This explains the behavior of each curve in the left panel of Fig. 10. 

In Fig. 11, we plot the maximal cross section as a function of mixing parameters. For non-zero 5ll mixings (left 
panel), we see that the maximal value of each curve lies at a moderate 5ll, which agrees with the above analysis. 
Among the three curves for different Msusy, the maximal value is obtained for Msusy = 800 GeV. The reason is 
that Msusy — 800 GeV implies heavier masses for the other two squarks and alleviates the cancellation between 
different diagram contributions. 
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FIG. 10: The maximal cross section of tc production at the LHC, proceeding through the parton-level channel gg —* tc, as a 
function of Xt by varying rrig and Sll or Slr- 



For the case of non-zero Slr, maximal cross sections also appear at the lower bounds of the lightest squark mass and 
the giuino mass. This property together with the effective teg coupling in Eq. (30), imply that the maximal value for 
each curve should lie at a large 5lr, or by the correlation, at small Xt- (Both Xt and 5lr appear as the off-diagonal 
elements in squark mass matrix. Thus, for a given Msusy, their large values enlarge the mass splitting between 
squark mass eigenstates and lead to a small mass for the lightest squark. Due to the lower bound on the lightest 
squark mass, Slr. and Xt cannot be both large.) This is in agreement with the behaviors of the curves for non-zero 
Slr shown in the right panels of Figs. 10-11. For the right panel of Fig. 10, we checked that for Msusy = 800 GeV, 
varying Xt from to 500 GeV only resulted in a change of 0.006 for Slr- This is the reason that the maximal cross 
section is insensitive to Xt for Xt < 500 GeV. 

In Fig. 12 we show the dependence of the maximal cross section on Msusy for non-zero Sll or Slr values. To 
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FIG. 11: Same as Fig. 10, but as a function of mixing parameters. 
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FIG. 12: Same as Fig. 10, but as a function of Msusy under different cases specified in the text. 



get the maximal cross sections, we fix the hghtest squark mass as 100 GeV and vary the value of 5ll or 5lr- We 
considered three cases, 

• Case I: Mq, = Mq, = Mu, = Msusy, 

• Case II: Mq, = Mu, = Msusy, Mq, = 1.2Msusy, 

• Case III: Mq, = Msusy, Mu, = 0.8Msusy,Mq, = 1.2Msusy- 

These cases are motivated by mSUGRA model [23] where the three squark masses are generated from the same soft 
breaking mass parameter mg at supersymmetry breaking scale, but are split due to quark Yukawa couplings when 
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they evolve down to clcctrowcak scale [36]. From this figure we see that the maximal cross section values increases 
with MgusY, and for non-zero (Slr), case I (II) gives the largest prediction for the cross sections. These results 
indicate that in searching for the maximum values of the cross section, we should treat Mq^ , Mq^ and Mu^ as free 
parameters and explore all the possibilities for these masses. 

Note that in the above discussions we have only considered the case for non-zero Sll or 5lr- But as pointed below 
Eq. (20), most of our conclusions should be valid for the case non-zero Srl or Srr ^ with an interchange of L and 
R. 



V. LOW-ENERGY CONSTRAINTS ON FCNC TOP QUARK INTERACTIONS 
A. Constraints on scharm-stop flavor mixings 

We know, from the discussions in the preceding section, that the rates of the FCNC top quark processes depend 
strongly on the flavor mixing parameters S^i^ and Slj^, which are treated as free. Of course, such a treatment is 
informative and useful to the LHC experiments since it allows to directly place limits on the mixing parameters once 
the measurements are made at the LHC. 

However, it is worth noting that these mixing parameters may be siibject to various direct and indirect experimental 
constraints. Firstly, since the mixing terms appear as the non-diagonal elements of squark mass matrices, they can 
affect the squark mass spectriim, especially by enlarging the mass splitting between squarks. Therefore they should 
be constrained by the squark mass bounds from the direct experimental searches. At the same time, since the squark 
loops affect the precision electroweak quantities such as Mw and the effective weak mixing angle sin^0e//[31, 37], 
such mixings could also be constrained by precision electroweak measurements. As shown in[17, 31], to a good 
approximation, the supersymmetric corrections to the electroweak quantities contribute through the Sp parameter 
and thus sensitive to the mass splitting of squarks. Secondly, the processes govcirncd by — > s transition like Bg — Bg 
mixings [20] and h S7[19] can provide rich information about the .1 — 6 mixings. Through the SU(2) relation between 
the up-squark and down-squark mass matrices (see Eq. (15)) and also through the electroweak quantities (since all 
squarks contribute to electroweak quantities via loops), the information can be reflected in the up-squark sector and 
hence constrain the scharm-stop mixings. Thirdly, we note that the chiral flipping mixings of scharm-stop come from 
the trilinear -ff2c2^fl inter actions [16]. Such interactions can lower the lightest Higgs boson mass mu via squark loops 
and thus should be subject to the current experimental bound on mh- 

In [17] these constraints were examined and it was shown that, although they usually depend on additional unknown 
parameters in the down-type squark mass matrix, a combined analysis can still severely restrict the mixings 5ll and 
5lr in most cases. Here we extend the analysis of [17] by providing more examples about these constraints and then 
perform a detailed investigation of the maximum rates for various top quark FCNC processes both with and without 
these constraints. 

The constraints considered in our paper arc h S7, Bg — Bg mixing, SMw and 6 sin^ 9i,fj and the lightest Higgs 
boson mass. In the following, we first recapitulate these constraints and then apply them to scharm-stop mixings. 

(1) b sj: In the MSSM, there are four kinds of loops contributing to b ^ S'j mediated respectively by the 
charged Higgs bosons, charginos, neutralinos and gluinos, each of which may be sizable [19]. For a light 
charged Higgs mass, the contribution from the charged Higgs is quite large and always has the same sign 
as the SM contribution, and thus enhance the branching ratio to very high values [38] . The current 6 ^ S7 data 
require either a sufficiently heavy charged Higgs boson, or its contribution should be canceled by other parts of 
SUSY effects. For the other three kinds of contributions, depending on SUSY parameters, they may interfere 
constructively or destructively with the SM effects and thus their relative sizes are not fixed [39]. The effect 
of these properties of SUSY on & ^ 57 makes it necessary to consider all the contributions simultaneously in 
discussing b .57 constraints on the squark flavor mixing parameters. 

Current measurement of the branching ratio for & ^ 57 is rather precise, with 3a bounds given by [40] 

2.53 X 10"'' < Br{b 57) < 4.34 x 10"^. (33) 

With the SM prediction Br^^'^{b .57) = (3.53 ± 0.30) x 10"'' [41] and a favored negative C7 by 6 ^ sl+l' 
[42], where C^ denotes the Wilson coefficient for the electromagnetic dipole operator Ot, this decay can severely 
restrict the SUSY parameters. Our numerical results indicate that it is very sensitive to S'^j^ and for most 
cases, and for large tan (3, it is sensitive to 5^^ as well. The same results also indicate that b ^ depends 
weakly on Slr which affects the decay via chargino-mediated loops, but under all circumstances 6 ^ 57 is not 
sensitive to Shl and Srr. 
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(2) Bs — Bs mixing: In the MSSM, although the loops mediated by charged Higgs boson, chargino and ncutralino 
contribute to Bg — Bg mixing, their effects are generally much smaller than the SM contribution[20]. So 
when discussing the constraint of Bg — Bg mixing on squark flavor mixing parameters, we only consider gluino 
contributions. Recently, the DO collaboration gave the first two-side bound on the mass splitting between Bs 
and Bs [43] 

17 ps-i < AMs < 21 ps"^ (90% C.L.) (34) 

This result is in agreement with the SM prediction, which is estimated as 21.3 ±2.6 ps~^ by the UTfit group [44] 
and 20.9^4^ ps"! by the CKMfitter group [45] . After considering various uncertainties, the bounds in Eq. (34) 
can be re-expressed as [46] 

0.55 <\l + M^Y^^IM^i^\ < 1.37, (35) 

where M12 is the transition matrix element for Bg — Bg transition. As pointed out in[20], Bg — Bg mixing is 
very sensitive to the combinations f^ii^^^ and Sf^i^Sj^j^ and thus can put rather stringent constraints on any of 

(3) 5MiY and S sin^ 9ef j : In the MSSM, the corrections to and sin^ O^f / involve the calculation of the gauge 
boson self energy, and among all kinds of contribution to the self energy, those from squark loops are most 
important [47]. As a good approximation, 5Mw and 5 svc? O^ff are related to 5p by[31] 

Mw c^w X 
6Mw ^2 _,2 

Ssm^Oeff^-^^^^Sp, (36) 



where 

EzjO) _ Svy(O ) 



6p^^-i^. (37) 



Since the couplings arc stronger for left-handed squarks than for right-handed squarks, 6p is sensitive to the 
mass splittings between left-handed up-squarks and down-squarks [47]. As far as 5ll is concerned, due to the 
SU(2) relation in Eq. (15), it changes up-squark and down-squark mass spectra simultaneously and thus its 
effects on Sp arc generally small even for large Sll- For 5lr and Srl, they are independent of d'[]^ and (5^^, 
which are very small as required by 6 — s transition [19-21]. Thus a large Slr or Srl can induce a sizable 
mismatch between up-squark and down-squark mass spectra. As a result, large 5lr or Sul can significantly 
change dp [17]. 

With the recent analysis of the LEP data, the uncertainties in measuring Myy and sin^^e// were significantly 
lowered to read [48] 

SMw < 34 MeV, ^ sin^ Oeff < 15 x 10"^ (38) 
These uncertainties imply that the new physics influence on 6p should be lower than 5.5 x 10~^. 

(4) Higgs boson mass mh: In the MSSM the loop-corrected lightest Higgs boson mass ruh is defined as the pole of 
the corrected propagator matrix, which can be obtained by solving the equation [49] 

/ - mltree + ^hh{p^)] " m^,^,,,, + Sffff (/)] - [±hH{p^)] ' = 0, (39) 

where nih^tree and ml tree are the tree-level masses of the neutral Higgs bosons h and H, and Si(p^) {i = hh, 
hH, HH) are the renormalized Higgs boson self energies. Among all SUSY contributions to the Higgs boson self 
energies, those from top and stop loops are by far dominant because of the large top quark Yukawa couplings [50]. 
In the presence of the fiavor mixings in the up-squark mass matrix, stops will mix with other squarks, and in 
this case, the dominant contribution comes from the up-squark sector [31, 51]. 

Our results indicate that the Higgs boson mass is more sensitive to S^ft than to S^l. The reason is that S^l 

affects the Higgs boson mass only by changing the squark interaction through the unitary matrix F in Eq. (16) 
while 6lr can also appear directly in the coupling of trilinear H2CLtR interaction, since the SlrMq^Mu^ term 



16 



in up-squark mass matrix comes from this trilinear interaction, and this can reduce the hghtest Higgs boson 
mass. Current collider searches for a MSSM Higgs boson have given the lower bounds on to/^ in five benchmark 
scenarios in Higgs physics[52]. In our calculation, we use the limit 

{92.8 GeV for to™°^ scenario 
(40) 
85 GeV for other scenarios 

As the first example of these constraints, we consider the m™"^ scenario with the parameters given in Eqs. (24,26). 
To determine these constraints, we also need to specify the values of the parameters in the down-squark mass matrix 
and the gaugino mass M2. In Fig. 13 we show the allowed region in Sll — ^lr plane for the parameters 

Ms = Mq. = Mu, = Md, = 500 GeV, XJOOO GeV, M~g = 250 GeV, tan/3 = 5, 
= = M2 = 500 GeV, 6rl ^ SrrO, = 4l = 4/? = 0- (41) 



Squark Mass 



Ms 
M- 



■ 500 GeV 
= 250 GeV 
= 500 GeV 



5 ° = 0. 




FIG. 13: Experimental constraints on Sll versus 5lr with the parameters given in Eq. (41). The region under or left to each 
curve corresponds to the allowed region. The dashed-Iine enclosed area is allowed hy b 57. The colored area is the overlap 
region satisfying all the constraints. 



Each curve in this figure corresponds to an experimental bound from Eqs. (27), (33), (35), (38) and (40); while 
the colored area is the overlap region satisfying all the constraints. The distinctive character of this figure is that 
6 — > 57 requires a non-zero 6^^. The reason is that with the fixed parameters in Eq. (41), especially with Sfj^ — 0, the 
charged Higgs contribution enhances the SM contribution and, as a result, a none-zero gluino contribution is needed 
to cancel such effects. From Fig. 13 we see that the allowed region is mainly determined by & ^ 57 and Bs — Bs 
mixing. To show the dependence of such allowed region on SUSY parameters, we vary the values of Ma, Ms, Mg 
and Sffi one at a time, and get the allowed region (colored area) in Figs. 14, 15, 16 and 17, respectively. Explicitly, 
Fig. 14 corresponds to the parameters in Eq. (41) but with Ma = 200 GeV, Fig. 15 corresponds to the parameters 
in Eq. (41) but with Ms = 1000 GeV , and Fig. 16 and Fig. 17 are drawn in a similar way. The shift of the allowed 
region can be well understood by the properties of each constraint. Take Fig. 14 as an example. As Ma becomes 
smaller, the charged Higgs contribution to — s- 37 further enhance the SM contribution and consequently a larger 
5ll is needed to cancel such effect and satisfy the bound in Eq. (33). Since the constraint from Bs — Bs mixing is 
not changed, the overlap region diminishes gradually and finally vanishes for Ma — 200 GeV. 

As the second example, we consider the following parameters as an input 

Mq^ = 400 GeV, Mq., = 1000 GeV, Mu.^ = 120 GeV, Mg = 196 GeV, Ma = 160 GeV, 

Xt = 33 GeV, M = -330 GeV, M2 = 860 GeV, Md, = Mq, = Md^ = 500 GeV, 

5^^,- 0.0026, 5b.l=6lb = 0, &rl=K.r = ^- (42) 

This set corresponds to a point in the parameter space where cf? — > t is maximized for non-zero 5lr (see following 
discussion about Table 1 and Table 2) and the results are depicted in Fig. 18. Since the squark masses are not universal. 
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FIG. 14: Same as Fig. 13, but for Ma = 200 GeV. 
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FIG. 15: Same as Fig. 13, but for Ms = 1 TeV. 



5lr > 1 can still satisfy all the constraints and thus is allowed. The reason for this is that all the constraints actually 
limit the size of the product SlrMq^Mu^. For the case discussed here, Mq^ and Mu^ are not large and thus a large 
S^ji is allowed. 

A common property of the above several figures is that Bs — mixing and b require a small 5ll value. 

This is a general feature, which accounts for the significant suppression of the maximal predictions for various top 
quark FCNC interactions after considering all the constraints (see the results in case ^-{Slr = 0) of Table 1) . We also 
considered the constraints on 5jil and 5jiR, which, as we pointed out earlier in this section, do not significantly affect 
6 — > S7 and Bs — Bs mixing, and hence are constrained only by 5p and the Higgs boson mass. We found that by 
comparing with the constraints on S^ji and (Sll, the constraints on these two mixing parameters, especially on (Sjjij, 
are rather weak. Let us consider parameters in Eq. (41) as an example. For 5ll = Slr = 0, our results indicate that 
Srr and 6rl should be less than 0.76 and 0.46, respectively. Such constraints come from 6Mw and Ssin^Oeff, and 
are sensitive to Xt- For Xt = 0, the bounds will be relaxed to 0.98 for 5rr^ and 0.75 for Srl- 
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FIG. 17: Same as Fig. 13, but for 5f ^ = 0.005. 



B. Maximal predictions in MSSM for FCNC top quark processes 

With the constraints discussed above, we perform a scan over the SUSY parameter space to search for the maximal 
predictions of the MSSM on various top quark FCNC processes. We consider two cases: (I) only Sll and (II) 
only Slr 0. For each case, we require the parameters to vary in the following ranges [61] 

2 < tan/3 < 60, < Mq^,c/.,d. < 1 TeV, 

94 GeV < TOA < 1 TcV, 195 GeV < rUg < I TeV, 

< Sll or Slr < 2, -1 TeV < fi, Nh < 1 TeV, 

0<6lii< 0.1, -2 TeV < At,b < 2 TeV. (43) 

To manifest the effect of the combined constraints on the maximal rates, we present two types of predictions: one by 
only requiring the squark, chargino and neutralino masses satisfy their current lower bounds 

mu > 96 GeV, mj > 89 GeV, m^o > 46 GeV, > 94 GeV; (44) 
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FIG. 18: Same as Fig. 13, but for the parameters in Eq. (42). In this case the Higgs boson mass cannot impose any constraints. 



and the other by imposing all constraints in Eqs. (44, 33, 35, 38, 40). With five million samples for each process 
in either case, we obtain the maximal predictions and they are given in Table I. From the table one can see that 
the combined constraints can significantly decrease the MSSM predictions for top-quark FCNC channels at the LHC, 
especially for the case I, and among these FCNC processes, eg th is the most affected one after imposing these 
constraints. The reason is that, as we pointed out before, there is a cancellation between the contribution from the 
effective interactions teg and ieh, and the constraints only allow a region with strong cancellation. 

Table 1: Maximal predictions for top-quark FCNC processes induced by stop-scharm mixings via gluino-squark loops in the 
MSSM. For the production channels we show the hadronic cross sections at the LHC obtained from the given parton-level 
channels and the corresponding charge-conjugate channels. For the decays we show the branching ratios. LHC sensitivities 
listed in the last column are for lOOfb^^ integrated luminosity. 
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Table 2: SUSY parameters leading to the maximal predictions for Slr in Table 1. 
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eg tZ 


370 


920 


80 


115 


196 


1.86 


eg th 


280 


1000 


85 


23 


197 


1.77 



As one can see from Table 1, predictions for the case with non-zero 5lr are larger than for the one with non-zero 
Sll- In Table 2 we list the SUSY parameters leading to the maximal predictions in Table 1 for the case II {Slr 0). 
It is seen from Table 2 that the 'favorable' parameters for the maximal rates are process dependent. Since these 
parameters could be first tested by seeking top quark FCNC signals at LHC, in Table 3 we present the predictions 
for all processes with two sets of parameters, called 'Point 1' and 'Point 2', where t ^ eh and eg ^ t are required 
to be maximized, respectively. It is seen that 'Point 1' favors eg ^ t as the production channel but 'Point 2' favors 
t egg among the decay modes. 

Note that in Table 1 we only showed the cases of Sll and Slr 0. For Srl ^ 0, we found that the maximal 
rate oi t ^ eg is 1.3 x 10~^ if only the squark mass constraints are included and 6 x 10~^ with all the constraints. 
For Srr ^ 0, the maximal rate oft ^ eg is 5.0 x 10~^ with only the squark mass constraints and 4.85 x 10~^ with all 
the constraints. These results can be easily understood since, as discussed in [17] and in this section, the constraints 
on SfiL and Srr are weaker than those for Slr and Srr, respectively. 

Table 3: SUSY predictions for the rates of top quark FCNC processes at two points of parameter space: 'Point 1' maximizes 
t ^ ch and 'Point 2' maximizes eg ^ t channel. 
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C. Top FCNC observability at the LHC 

Now we consider the observability of these top quark FCNC interactions at the LHC. This issue has been intensively 
investigated in the effective Lagrangian approach for t ^ ch [53], t ^ cZ [54, 55], t ^ ej [56, 59], pp ^ t + X [33], 
pp^tc + X [34, 35], pp^tg + X[34, 35], pp ^ tZ + X[57], pp ^ t-f + X[57] and pp ^ th + X[53]. At the LHC, 
most of the top quarks will be pair-produced. One of the tops is assumed to siibseqiiently decay as < — » bW (normal 
mode) while the other top goes to one of the above channels via FCNC interactions (exotic mode) . 

Due to the large QCD backgrounds at the LHC, the search for these processes must be performed in the decay 
channels W — > £Pi {£ = e, p) for W boson, Z for Z boson and h bb for Higgs boson. For any of these 

reactions, top quark reconstruction is required to extract the signal from its background. In Table 4, we list the signals 
and the main backgrounds. The detailed Monte Carlo simulations for the signals and backgrounds can be found in the 
corresponding literature listed in the last column of Table 1, where the LHC sensitivity for these processes is quoted. 
Although these sensitivities are based on the effective Lagrangian approach and may be not perfectly applicable to 
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the MSSM, we can take them as a rough criteria to estimate the observabihty of these channels. Comparing these 
sensitivities with the SUSY predictions, one can see that only the maximal predictions for eg t and t ch are 
slightly larger than the corresponding LHC sensitivities. This implies that the study of these processes may provide 
the first insight about top quark FCNC. From these sensitivities one can also see that, although the gg tc channel is 
now the most extensively studied among the FCNC production channels [11], its observation needs a higher luminosity. 
This is because gg tc has large irreducible backgrounds from single top productions in the SM [34]. Note that in 
Table 1, we did not list the sensitivity of the LHC to t ^ eg, which has not been investigated because of a general 
belief that this decay is not well suited for detecting teg interaction [5]. In fact, this decay was once investigated 
for the Tevatron [58], and it was found that due to the large background, namely W boson plus three jets, only a 
branching ratio as large as 5 x 10~^ may be accessible with 10 fb~^ integrated luminosity. This rate is about one 
order larger than that for t — > C7 at the Tevatron with the same luminosity [59]. For the decay t — > egg, there is an 
additional jet in its signal and its observability needs to be studied by a detailed Monte Carlo simulation. 

Table 4: Experimental signature and main background for FCNC top rare decays and productions at the LHC. The top quarks 
are assumed to decay t — > W~^b — > t^veh, and Z and h bosons decay in the channel Z — > and h — > 66, respectively. 
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VI. CONCLUSIONS 

In this paper, we investigated systematically the SUSY-induced top quark FCNC processes at the LHC, which 
includes various decay modc;s and production channels. We performed a comparative study for all the decay modes 
and for all the production channels so that one can see clearly which decay mode or production channel can have a 
relatively large rate. The dependence of these channels on the relevant SUSY parameters is investigated in detail and 
its properties are analyzed. We note that such a global study of the top quark FCNC processes has been done only 
in a model independent way [5]. We also analyzed the characteristics of the 'favorable region' in SUSY parameter 
space where the FCNC processes are maximized. After getting an understanding of these processes, we examined 
the effects of all the direct and indirect experimental constraints on the scharm-stop flavor mixings and scanned the 
parameter space to find their max;imal rates with these constraints imposed. We found that eg ^ t and t ^ ch are 
the most likely channels to be observable at the LHC if the MSSM is the correct scenario beyond the SM. 
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APPENDIX A: EXPRESSIONS FOR THE LOOP RESULTS 

If significant flavor mixings exist only between left-handed scharm with stops, the squark states Cl, II and in will 
mix together to induce various top quark FCNCs. In this case, other squark states only serve as spectators to the 
processes considered in this paper. So in the actual calculation, we only need to consider the squark mass matrix for 
(ti, iij, Cl), which is given by 

+ + (5 - Pw)^z cos 2/3 mtiAt - /icot/3) SllMq^Mq^ \ 

nit {At - /i cot (3) +m^ + js'^ cos 2/3 SlrMq^ Mu^ . (Al) 

5llMq,Mq^ 6lrMq,Mu, + {\- ^s'^^ Wz cos 2/3 / 
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This mass matrix can be diagonalized by a unitary matrix V, and it enters the squark interactions as in Eq. (16). 
In this Appendix, we hst the expressions for S and T^^f^ in Eq. (22) which are needed to get the effective teg 

vertex. We also list the expressions for T*^^, T*"^ and T*^^ to calculate other effective vertices. Before presenting 
these expressions, we define the following abbreviations: 

3 

= Y,V,xV^^B{p,mg,mx), R" = R''\v,,^v,„ (A2) 

A=l 



R" = ^VixV^^C{-pc,Pc-Pt,mg,mx,mx), R'^ = R''\v,^^V2x^ (A3) 

A=l 



R" = ^VixVlr^C{-pc,Pc-Pt,'mx,mg,mg), R^ = R^lv^^^^Vix, (A4) 



R3 = ^VixV^^C{-pb,Pb-Pt,mg,mi,^,mx), (A5) 



R'' = J2 VixF^pV^sC{-p,,Pc-pt,mg,mp,mx), R' = R%,^^v,x, (A6) 



R' = ^ VixF^pV^3C{-pc,Pc-Pt,mg,mp,mx), R'' = W\v,x^v,x, (A7) 

p,A=l 



i?' = '^VxxVlr^D{-pt,pi,pumx,mg,mg,mg), i?™ = iJVi^^v^^, (A8) 

A=l 

3 

i?" = ^VxxVl^D{puP2,-Pt,mx,mx,mx,mg), i?° = (A9) 

A=l 



R^ = ^VixVlriD{-pt,p2,-Pc,mx,mg,mg,mx), = R^\v^^^V2x^ (AlO) 

A=l 

where p and A are squark indices in mass eigenstate, pi is particle momentum, B, C and D are loop functions [27], and 
F^p and F^^ are interaction coefficients for QxQpZ and QxQph interactions respectively, which are given by 

F^p = (1 - ls'w)SpX - vl,V2p (All) 
< = (-^ ^osaiV^^y^p + V;:,V2p) + cosa + Msina) ^ 

^ S.nM,^Mu.cosa ^^,^^^^ + V.^.V^s.)) • (A12) 
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Then after factoring out the common factor Q!s/47r, we obtain the expressions for S and Fs: 

S(p) = -2Cir(7''i?«+m§i?g)Pi, (A13) 

-l"lf.l/cK + I'l^^l^Kx + ml-i^Rl - m-gj^j/^Rl + 2m~gRl - m-gj/tJ^^Rl^ Pl, (A14) 



^bcw ^ J-CFYPL{pb^Ri-R%), (A15) 



r^^^ = -^Cp{{pt+Po)^{l''Rl-mgRi)-2{^'^R';^^-mgR'^))PL, (A16) 

r^'^^ = -2eQuCF{2i''R1,-2mgR'l-{pt+Pc)^{l''Rl-mgRt))PL, (A17) 
T^-^ = -2CF{rRi-mgRi)PL, (A18) 

where Cp is the quadratic Casimir operator of the fundemantal representation of SU{3)c- 
For the box diagrams in Fig. 2, their results are given by 

Md = -2a^T-T«/''^''r'"£^(P2)£^(pi)«t(-m§mt7^(??^-]/2)7^i?^ 

-mtj^(j/,-p!,)YrRl + mtj^ri'i^Rl. + ^''^^u-i/2h''rRl. - r^^rYi^Rl^a 

+mlma^YRl, - mlj'^^^YRl + m§mt7S^7"i?ir - m57''7S^7"i?".) PlVc, (A19) 
Me = -8a^T«T'*T^T"4(p2)e^(pi)St {j^R^p^ + j^pixR^p + m-gR;^ + m-gP^xR;) Plv,, (A20) 
Mf = -AalT-T^T'f-'ei{p2)s';,{p,)ut{ma^(j/,^l/2)R'p 

-ma^j'^R:'^,, - Yl^Wt-l/2)Rlp + 7^7^7''i?^.p - m-gma^Rl 

+mg^^^^Rl, - mg^^{i/,-i/^)Rl + m~g-i^YR% + ml^^R^,) PlVc- (A21) 
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